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-subpixel optimization routine (using line coverage)~2900 
-for each row in output image-2901 
-for each pixel in row-2902 

-for each subpixel in pixel-2904 

-for each of its scan lines-2906 

-calculate each intersection between that scan 
line and a pixel boundary-2908 
-for each portion of a scan line which occurs 
between two scan line ends, a scan line end and 
a pixel boundary, or two pixel boundaries-2910 
-add to a coverage value associated with 
the subpixel the multiple of the percent of 
that scan line covered by the portion times 
the component color value of the pixel 
covering that portion corresponding to the 
color of the current subpixel, all divided by 
the number of the subpixel's scan 
Hnes-2912 

-Set the pixel's color value equal to a color having an 
compound RGB value with red, green, and blue values equal 
to the subpixel luminosity value of the pixel's red, green, and 
blue subpixels, respectively -2914 

FIG. 29 
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-subpixel optimization routine (using area coverage)-4100 
-for each pixel row in output image-4102 
-for each pixel in row-4104 

-for each subpixel in a pixel- 41 06 

-determine which pixels of source image are in a source 
image window associated with the subpixel-4108 
-for each such included source image pixel-4110 

-calculate the percent of the subpixel's source 
image window's area covered by the pixel's 
area-4112 

-add to a luminosity value being calculated for the 
subpixel the multiple of the percentage of the 
subpixel's source image window area covered by 
the pixel times the pixel's color component value 
corresponding to the color of the current subpixel 
-4114 

-Set the pixel's color value equal to a color having an 
compound RGB value with red, green, and blue values equal 
to the subpixel luminosity value calculated for the pixel's red, 
green, and blue subpixels, respectively.-^ 1 16 
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-subpixel optimization for bicolor bitmap -5300 
-for each pixel row in image-5301 

-for each pixel in row~5302 

-for each subpixel in the pixel-5304 

-determine which pixels of source image are in a 
window portion of source image corresponding to 
subpixel's area in scaled image-5306 
-for each source image pixel all or partially in the 
subpixel's source image window-5308 

-calculate the percent of the window's area 
covered by the pixel's area~5310 
-add to a luminosity/coverage value calculated for 
the subpixel the multiple of the percentage of the 
window area covered by the pixel times the pixel 
average foreground color intensity-5312 
-find the minimum subpixel luminosity/coverage value so 
calculated for the pixel-5314 
-for each subpixel in pixel-5316 

-set a luminosity/alpha value being calculated for the 
sub and the pixel to the pixel's minimum subpixel 
luminosity/coverage value-5318 
-distribute that portion of the subpixel's 
luminosity/coverage value that exceeds the pixel's 
mininum subpixel luminosity/coverage value to the 
luminosity/alpha values being calculated for the subpixel 
and adjacent subpixels in the pixel row using a color 
balance distribution filter-5320 
-For each pixel in row-5322 

-set the pixel's color value equal to a color having an 
compound RGB value with red, green, and blue component 
values equal to thlse luminosity/alpha values calculated for the 
pixel's red, green, and blue subpixels, respectively. -5324 
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-subpixel optimized font bitmaps with non-linear color balance-6000 
-for each pixel row-6002 

-for each subpixel in a row-6004 

-determine a coverage value representing the perecent the 
subpixel which is covered by the font shape-6006 
-for each pixel in row~6008 

-determine the minimum coverage value calculated for each of 
its three subpixels -6010 

-add minimum to temporary alpha value being calculated for 
each subpixel of the pixel-6012 
-for each of pixel's subpixels~6014 

-determine excess of subpixel's coverage value over the 

pixel's minimum~6016 

-distribute this excess value into sub-pixel alpha values 
based on color balance distribution filter appropriate for 
sub-pixel's color-6018 
-for each pixel in row~6020 

-use the three color alpha value defined for each pixel by the 
three alpha values calculated for its subpixels in a look-up table 
to map that value into one of relatively small palette of 
colors-6022 

FIG. 60 
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-Center-Weighted Color Balance Filter-9400 

-For Coverage Value 0 0,0,0,0,0 

-For Coverage Value 31 0,1,1,1,0 

-For Coverage Value 62 0,2,2,2,0 

-For Coverage Value 93 1 ,2,3,2, 1 

-For Coverage Value 1 26 1 ,3,4,3, 1 



FIG. 94 



-Asymetric Color Balance Filter-9500 

-For Coverage Value 0 0,0,0,0,0 

-For Coverage Value 31 1,1,1,0,0 

-For Coverage Value 62 2,2,2,0,0 

-For Coverage Value 93 3,3,3,0,0 

-For Coverage Value 1 26 3,3,4, 1 , 1 
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-Creation of input-color-to-output-color look-up table-9600 

-run the characters of multiple fonts through non-linear algorithm for deriving 
subpixel optimized font bitmaps, while keeping a histogram of the number of 
times each of one of the 2196 possible three color alpha values is calculated 
for a pixel-9602 

-create a 1 22 color output palette by~9604 

-selecting the thirteen grayscale colors possible for whole pixel alpha 
values in which each subpixel can have one of thirteen levels 
including, black and white-9606 

-selecting the 109 other most frequently occurring colors in the 
histogram-9608 
-for each of the 2196 possible calculated alpha values-9610 

-if that input color exactly matches one of the pallette's colors-9612 
-associate the input color with that palette, or output, 
color-9614 
-if not-9616 

-for each of 122 output colors-9618 

-if (ri-ro) and (gi-go) are of same sign and if 
|ro-go| < |ri-gi|+x~9620 

-calculate the distance from the input color to the 
output color-9622 

-if that distance is the closest distance so far to 
the input color-9624 

-save it as closestAllowed- 

PaletteColor-9626 

-associate the input color with the 
closestAllowedPaletteColor-9628 

FIG. 96 
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-Displaying text with font bitmaps having subpixel alpha value components -9700 
-for each string to be displayed-9702 

-sample points in rectangle of bitmap in which it is to be drawn to 
determine its background color-9704 

-for each of the 122 whole pixel alpha values used to represent font 
bitmaps-9706 

-for each of the three subpixel component colors-9708 

-calculate color luminosity for the subpixel component 
color as the current subpixel's alpha value in the current 
whole pixel alpha value ( the current supixel's alpha) 
times luminosity of the current subpixel color in the 
foreground color with which the fonts are to be drawn 
plus (1 minus the current subpixel's alpha) times the 
luminosity of the current subpixel's color in the 
background color-9710 

-map the current whole pixel alpha value to the whole pixel 

color comprised of the three subpixel luminosities calculated 

for the whole pixel alpha value-9712 
-for each character of string to be displayed-9714 

-access its associated font bitmap-9716 

-for each of pixel of the font bitmap-971 8 

-find the color value which has been mapped to the 
pixel's corresponding whole pixel alpha value in the font 
bitmap-9720 

-set the corresponding pixel in the subpixel addressable 
display to that whole pixel color value-9722 
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-Sample html-10300 
-</head> 
-<body 

background="http://a1636.g. akamai. net/7/1 636/797/e5e77dd148cc98/graphi 
cs.boston.com/globe/images/tiles/tile.gif link="5C331 7" vlink="5C4033" 
onl_oad="FrameThis()"> 



y 10300 

y 1 0300 

-<B>E-mail to a friend</b><BR> *r 

-<a href="http://tools. boston. com/pass-it-on/popular/">See what stories 

users are sending to friends</a><p> 

+^ 10300 ^10300 
-<B>Free headlines e-mail</B><br> 

-<a href=7newsletters/headlines/">The best of the Globe each weekday 
morning</a><p> 0Q 

if y 10300 

-<B>Altemative views</b><BR> 

-<a href=7globe/lowgraphics">Low-graphics version</a><br> 
-<a href=7globe/acrobat/today.pdf>How it looks in print</a> 

-<P> y 10302 *\ 

/ 10300 
-<!--S£CTIONS--> 
-<IMG WIDTH="120" HEIGHT="27" 

SRC="http://a1636.g.akamai.net/7/1636/797/0df5e88d0bb528/graphics.bost 
on.com/globe/images/navs/nsections.gif border="0" alt="Sections" 
VSPACE="1" WIDTH="120" HEIGHT="27"><BR> 
-<a href=7globe" onMouseOver="loadimage('pageone', 
'http://graphics.boston.com/globe/images/navs/rpageone.gif); status='Boston 
Globe Online: Page One'; return true;" onMouseOut="loadimage('pageone', 
'http://graphics.boston.com/globe/images/navs/npageone.gif'); status-'; 
return true;"><IMG WIDTH="1 19" HEIGHT="14" 

SRC="http://a1636.g.akamai.net/7/1636/797/f0a63d528dc7e3/graphics.bost 
on.com/globe/images/navs/npageone.gif border="0" alt="Boston Globe 
Online: Page One" name="pageone" VSPACE="1"></a><br> 



FIG. 103 



41/92 




] □ 



FIG. 104 



42/92 



-Browser's Proxy Code-10500 

-if receive request from thin client for a web page- 1 0502 

-relay request to server indicated in URL of request-10504 
-if receive indication that browser has completed a screen draw or 
red raw**- 10506 

-call the screen capture and download routine when screen redraw is 

complete -10510 
-if receive control object state query from browser- 1 0514 

-query thin client for state of indicated one or more controls-10516 

-send those control states to browser-1 051 8 
-if receive scroll/move command from thin client-10520 

-move view window accordingly relative to browser's virtual 

screen-10522 

-if portion of view window which was in view window before move is 
still in view window-10526 

-place appropriate scroll command at start of download display 

list- 1 0528 

-if moved view window includes portion of web page not currently in 

virtual screen-10530 

-scroll browser's virtual screen accordingly^ 0532 
-request redraw for the newly scrolled virtual screen from 
browser-1 0534 
-if receive zoom command from thin client-10536 

-change view scale factor accordingly-10538 

-scale view window accordingly relative to browser's virtual 

screen-10540 

-if scaled view window includes portion of web page not currently in 
virtual screen-10542 

-scroll virtual screen change its resolution to cause scaled view 

window to fit in virtual screen-10544 
-call for screen redraw-10552 
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-if receive virtual resolution command from thin client-10554 

-change browser's virtual screen resolution to requested virtual 

resolution- - ! 0556 

-call for screen redraw- 1 0560 

-if receive other user input event from thin client-10562 

-transform its screenXY on client screen to corresponding location in 
browser screen using location of view window and display scaling 
factor-10564 

-relay event to browser's event queue-10566 
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-Screen Capture And Download Routine-10600 
-ask for browser for screen redraw-10602 
-if browser calls- 1 0604 

-measureString-1 0606 

-map requested font family and font size into substitute font 
family and size, including:-! 0608 

-select size for substitute fonts as a function of the 
requested font size and downscaling by the display 
scaling factor-10610 

-replace smaller size fonts with narrower and taller size 
to take advantage of the higher ratio of horizontal 
resolution of subpixels- 1 061 2 

-if limitMinimumFontSize is on-10614 

-prevent substitute font size from being below a 
minimum pixel size-10616 
-return string measurement for substituted font and font size, 
scaled up measurements by display scale factor-10618 
-stringDraw~1 0620 

-transform string's virtual screen screenXY to thin client 
screenXY by scaling and/or translating as a function of the 
display scale factor and the view window's position relative to 
virtual screen-10621 

-if substituted font family and size associated with string in prior 
measure string call and any other font attributes for string is 
different than current font attribute for end of display list~1 0622 
-store a font command at end of display list changing 
current font attributes to attributes corresponding to 
current string- 10623 
-store string, its thin-client screenXY, and its substituted font, 
including size and color, at end of download display list— 10624 
-rectangleDraw-1 0626 

-transform rectangle's virtual screen screenXY, width, and 
height to thin client screenXY, width and height by scaling 
and/or translating as a function of the display scale factor and 
the view window's position relative to virtual screen-10628 
-if rectangle's color is different than background color for 
current end of download display list— 10630 

-add a background color command changing to new 
background color at end of download display list— 1 0632 
-store rectangle, transformed screenXY, width, and height at 
end of download display list— 1 0634 
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-bitmapDraw~1 0636 

-if images URL is not already in a download image list— 1 0638 
-if bitmap is color bitmap-10642 

-scan image for one or more portions of sufficient 
size which have only colors from a given bicolor 
spectrum~10644 

-for each bicolor portion of image found-10646 
-perform bicolor subpixel optimization, 
scaled down by display scale factor, on 
portion using opposite ends of its bicolor 
spectrum as foreground and background 
color at display scale factor-10648 
-if foreground color is too chromatically 
unbalanced, render image with a 
substituted more-balanced foreground 
color-10650 

-for each non-bicolor portion of image 
found-10652 

-perform multicolor subpixel optimization, 
scaled down by display scale factor, on 
bitmap using color image subpixel 
algorithm at display scale factor-10654 
-else if bitmap is grayscale bitmap-10656 

-perform bicolor subpixel optimization, scaled 
down by display scale factor, on bitmap using 
black and white as foreground and background 
colors at display scale factor-10658 
-store scaled-down, subpixel-optimized bitmap, with a 
unique imagelD, transformed width and height, and its 
URL at end of image list-10662 
-transform image's screenXY for download and store an image 
location command having the imagelD and the transformed 
screenXY, width, and height stored for the image in the image 
list at end of download display list— 1 0664 
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-controICreate- 1 0666 

-transform control's screenXY by scaling and/or translating as 

a function of the display scale factor and the view window's 

position relative to virtual screen-10667 

-place corresponding control command, its transformed 

screenXY, and corresponding text in download list— 10668 

-create corresponding browser-side portion of distributed 

control-10670 

-when screen redraw is complete-10672 

-call download display list routine-10674 
-clear display list— 1 0676 

FIG. 106C 



-download display list routine- 1 0700 

-select all elements in display list which will be all or partially be included in 
the new image which is to be created on the thin client's display screen in a 
download stream-10702 

-place all bitmaps in image list corresponding to one or more image locations 
commands in download stream at end of download stream, performing lossy 
compression on them first-10704 

-user a lossless compression algorithm to compress download 
stream- 10705 

-open a the socket connection between browser's computer and thin 
client-10706 

-send display list to thin client over socket connection-1 0708 
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-Download Stream-10800 

-clearCmd-10802 
-scrollCmd + XYShift-10804 

-backgroundColorCmd + color-10806 
-rectanglleCmd +ScreenXY + width + Height-10808 
-rectanglleCmd +ScreenXY + width + Height-10808 

-backgroundColorCmd + color- 10806 

-imageLocationCmd + ImagelD + ScreenXY+ width + height-10810 

-FontCmd + FontAttributel + NewValuel + FontAttribute2 + 

NewValue2-10812... 

-StringCmd + ScreenXY + String-10814 

-StringCmd + ScreenXY + String-10814 

-imageLocationCmd + ImagelD + ScreenXY+ width + height-10810 
-FontCmd + FontAttribute3+ NewValue3.. .-10812 
-StringCmd + ScreenXY + String-10814 

-StringCmd + ScreenXY + String-10814 

-StringCmd + ScreenXY + String-10814 

-rectanglleCmd +ScreenXY + width + Height-10808 

-ControlCmd + ControllD + ControlType + ScreenXY + 

ControlTextList-10816 

-StringCmd + ScreenXY + String-10814 

-ControlCmd + ControllD + ScreenXY + Control Label-10816 

-ImageCmd + ImagelD + width + height + Bitmap-10818 
-ImageCmd + ImagelD + width + height + Bitmap-10818 
-ImageCmd + ImagelD + width + height + Bitmap-10818 
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-thin client code-10900 

-if receive a download stream, start responding to individual commands in 
stream in the order in which they are received as soon as one or more are 
received, including responding to each of the following commands as 
follows- 1 0902 

-clearCmd -10904 

-clear thin client screen- 1 0906 
-scrollCmd-10908 

-bitblit portion of screen which remains on screen after XYShift 
to appropriate position after that shift-10910 
-clear rest of screen- 1 091 2 
-backgroundColorCmd- 1 091 4 

-set current rectangle background color to the color specified in 
command- 1 091 6 
-rectangleCmd~1 091 8 

-draw rectangle with upper left hand corner at ScreenXY, 
having the width and height specified in command, using 
current background color- 1 0920 
-imageLocationCmd- 1 0922 
-do nothing- 1 0923 

-FontCmd + FontAttributerl + NewValuel + FontAttribute2 + 
NewValue2.. -10924 

-set current value of all font attributes listed in command to the 
corresponding values listed in the command- 1 0926 
-StringCmd + ScreenXY + String- 1 0928 

-if thin client does not have font bitmap for each character of 
the specified string at the current font size and font 
family- 1 0930 

-send separate HTTP request for font of each such 
bitmaps from font server, specifying size, character, 
font, and that is to be subpixel optimized, and subpixel 
array type- 10932 

-when receive each requested font-10934 
-place it in font bitmap cache-10936 
-if have all characters of string specified in the 
command- 1 0938 

-draw string, using current font attributes values, 
including foreground color, and using color from portion 
of screen on which it is being written as the background 
color-10940 
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-ControlCmd + Control ID + ControlType + ScreenXY + 
ControlTextList-1 0942 

-if no control has been created having controllD specified in 

command-10944 

-create thin client side of distributed control associated 

with that controllD-10946 
-draw specified control type on screen using subpixel optimized 
bitmaps for control image, at specified screenXY, using 
drawing one or more text items in controlTextList using 
subpixel optimized text, and set control's associated screen 
hotzone, if any to the appropriate portion of screen-10948 
-lmageCmd-10950 

-for each imageLocationCmds in display list having same 
lmagelD-10952 

-draw bitmap at that location-10954 
-redraw all other items in display list which occur at the same 
location as any of these drawn bitmaps-10956 

-if user clicks hotzone assocated with text entry field-10958 
-execute keyboard mode routine- 1 0960 

-display pop up user keyboard and text edit line, saving the 
bitmap which was in its location-10962 
-until user presses enter- 1 0964 

-if user user types text character- 10966 

-place corresponding subpixel-optimized text 

shape on text edit line-10968 

-add character to position corresponding to 

cursor in a temporary text-edit string 

variable-10970 

-when user press enter, -10972 

-store text-edit string state in corresponding text field 
control-10974 

-draw text-edit string in bitmap of text entry field using 
subpixel optimized fonts-10976 

-remove popup keyboard, replacing the bitmap with was 
in its place before it was displayed-1 0978 
-else if user clicks on hot zone of a button or menu item control-10980 

-change appearance of button or menu item appropriately- 10981 

-send event along with button or menu item ID up to proxy-10982 
-else if user clicks on hot zone of another type of thin client control-10983 

-change appearance of control appropriately-10984 

-store user selected state change- 10985 
-else if user clicks on other portion of screen not associated-with the thin 
client program's or its computer's control interface-10986 

-send even with screen location up to proxy- 10987 
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-if receive query from proxy process re state of control-10988 

-query state of corresponding control on thin client-10989 

-transmit state to browser- 10990 
-if user enters a command to scroll screen-10991 

-upload command to proxy-10992 
-if user enters a command to change zoom, -10993 

-upload command to proxy-10994 
-if user enters a command to change virtual resolution,~10995 

-upload command to proxy-10996 
-if user enters another command associated with thin client's control 
GUI-10997 

....-10998 
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-proxy browser code with use of page layout caching~1 1500 

-if receive request for web page with an associated view setting~1 1502 
-request web page from server- 1 1 504 

-when a web page is received from a server- 1 1506 

-have layout engine layout web page at the virtual screen resolution 
specified in the view setting, substituting fonts for layout engine's 
measure string calls according to view setting's appropriate scale 
factor-11507 

-select virtual screen position relative to resulting layout which will fit 
the view window implicit in the view setting, and redraw 
screen-1 1508 

-when receive image referenced in web page-1 1518 

-scale and subpixel optimize image according to scale 
factor-11520 

-once have all images referenced in web page-11522 
-compress layout and images~1 1523 
-download layout followed by images- 1 1524 
-if receive request from thin client to rescale and subpixel optimize bitmaps 
of images at a given scale-1 1526 

-rescale and subpixel optimize them-1 1528 
-compress them~1 1 530 
-download them to thin client-1 1532 
-if input event from thin client- 1 1534 

-if its layout coordinate associated with it is not currently on virtual 
screen~1 1536 

-scroll virtual screen so that it is-1 1538 
-calculate virtual screen coordinate corresponding to layout 
coordinate-1 1 540 

-place input event with calculated virtual screen coordinate in 
browser's event queue -1 1542 
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-thin client code with use of page layout caching~1 1600 

-if start receiving downloaded page layout display list-1 1602 

-set mapping of view window to page layout and calculate scale factor 
as function of view selection-1 1 604 

-display received elements of display list which fall within view window 
at current mapping of screen window to display list, including current 
scale factor- 1 1606 

-if user generates input to changes size or location of view window relative to 

downloaded layout- 1 1616 

-make the corresponding change to the mapping of view window to 
display list and calculate scale factor as function any such 
changes- 1 1618 

-display any portions of page layout which fall within current view 
window at current scale factor including-1 1620 

-displaying strings with font sizes which are function of current 
scale factor, and adjusting for disproportionate changes in size 
of individual or all characters as font sizes change, by changing 
spacing between characters-1 1622 
-if there is a new scale factor- 1 1 624 

-requesting proxy to re-scale at new scale factor and 
subpixel optimize all images on screen at new 
mapping-1 1626 

-scaling at new scale factor and re-subpixel optimizing, 
and displaying the previously downloaded bitmaps of all 
on-screen images-11628 

-when newly scaled images are received, displaying 
them in place of locally rescaled versions- 1 1630 
-if user generates input event relative to screen-1 1632 

-use view-window-to-page-layout mapping to determine location of 

input in layout cooridinates-1 1634 

-send input event and page layout coordinates to proxy-1 1636 
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» Americans Work More Than Anyone 
Die Germans, the Brits — theyVe got nothing on the amount of work the average | 
American does. Even the Japanese work less. Day One of ABCNEWS.coms four- 
day series on the impact of the American workload takes a look at how much time 
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AnABCNEWS.com poll finds that more than one in four Americans feel they are 
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-Client code for selected text reflow-12900 

-If user selects area of downloaded page layout for text reflow at a new scale 
factor-12902 

-select all strings and corresponding underlines in layout which are substantially 
within selected layout area-12904 

-label any group of one or more strings whose closeness in layout 
indicates that they are part of the same paragraph-12906 
-reflow and display the text of each group of strings labeled as a 
paragraph across screen area's across boundaries at new scale 
factor, underlining text in reflowed lay that was underlined 
before- 12908 
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-font server code- 1 3900 

-if receive http request for one or more characters of a font-13902 

-if there is a font file matching having path name spacified in http 
request-13904 

-send that file over network in an http response to network 
address from which the font request came-13906 
-charge account associated with transaction- 13908 
-else if font request is for a font bitmap- 1 3910 

-generate font bitmap file having attributes indicated for font by 
path name, including- 1 391 2 

-if font request specifiestaht a subpixel optimazed 
version of the font is desired- 1 391 4 

-generates subpixel optimized font of character 
using non-linear color balancing-13916 

-send that file over network in an http response to the 
requesting address-13918 

-cache the font bitmap file at address corresponding to path 

name specified in request-1 3920 

-charge account associated with transaction-13922 



FIG. 139 



64/92 



Remote computer 




O.S. 



1Q212A 



14012 



Routines 



measureString 
stringDraw 
lineDraw 
bitmapDraw 



Event Queue ^i 




Dispatch Table 
routineAdr 
hook — 
hook — 
hook — , 



Remote Screen Generator 



Download Display List 
bitmaps & loc. 
lines & loc. 
strings & font & loc 



Routines 

— bitmapDraw ^ 

— lineDraw ^ 

— stringDraw ^ 
measureString 



Zoom, Scroll, and 
Virtual Resolution 
Control 



Event 
Position 
Scaler 



Network 



10222 
10224 



client computer 



OS 



Event 
Queue 



10220 



screen 



Client Screen App. 



Routines 

Zoom Control 
^ Input Relay 



drawBitmap 
drawLine 
drawString 



200 




Display List 

— bitmaps & loc. 

— lines & loc. 

— strings & font & loc 



Subpixel opt. fonts 



FIG. 140 



65/92 



10220A 



Computer 



14002 




Routines 



stringDraw- 

lineDraw 

bitmapDraw 



measureString 



Event Queue 



Dispatch Table 
routineAdr 

hook 

hook 

hook 



Scaled-Subpix. Opt. Screen Gen. 



Routines 

— Zoom & Scale 



stringDraw 
lineDraw 
bitmapDraw 
measureString 




Virtual Screen Display List 
bitmaps & loc. 
lines & loc. 
strings & font & loc 



View 
Window 



5 



Zoom, Scroll, and 
Virtual Resolution 
Control 





FIG. 141 



66/92 




doaa. Ev*n ttta ^sm* work 
l«M. Day Or* of ABCNEWS - 
COm'» four-day urm on 0» 




Subpixel 
Optimized 
Application 
Server 



14000AB 



Day Ona of ABCNEWS - 
com» four-day M ' — "*" ' 



FIG. 142 



67/92 



r 



200A 



TestTest.txt 



o 

TIE 



File Edit View Insert Format 
Tools Table Windows Help 



This is text produced by this 
computers operating system 
in the portrait orientation in 
which this computer's oper- 
ating system and graphical 
user interface was designed 
to work. 




FIG. 143 



200A 




W * 

E-mail to a friend 

^^natttgrfesusfers 



art'BnairaftfriSfgg 



M 

free headlines 
e-mail 



rnc r fl j no . v 
'Alternative v-t *wt 



Hgffit HKifca in arin : 



nraaw. ir i, loot 



luxury by design, qua lily by che nee 




Contractors cutting comers, developers nrateadln* 
customers - irw GtoDes spotlight Team nas 
uncovered scores of such prociems in new 
suburban housing. Todays stories document 
substandard materials and workmanship in 
high-end homes. 





V"' 







Energy plan to promote new 

supply 

Cheney pushes drilling over 



□ 



FIG. 144 



68/92 



-rectanglleCmd-14500 

-draw rectangle with screem position, height, and width defined with higher 
resolution than screen pixel resolution, using bicolor subpixel optimization 
and using current background color-14502 

FIG. 145 



-downloading web applets which creates subpixelized elements on screen- 1 4600 
-server and/or proxy- 1 4602 

-in response to request for media from thin client download media 
including applets- 1 4608 

-client- 1 4604 

-request media- 1 4606 

-receive media including applet- 1 4610 

-load and run applet- 1 461 2 

-applets draw subpixel optimized elements to subpixel addressable 
screen on client- 1 461 4 

FIG. 146 



-subpixel optimization of 3-d animations- 1 4900 

-for each of successive frame times- 1 4902 

-run 3-d animation engine to create bitmap of current frame, or at 
least of those portions of image which have changed since the last 
frame, at a higher resolution than the resolution at which subpixel- 
optimized images will be displayed- 14 904 
-scale-down and subpixel optimize frame bitmap, or at least of 
changes in it since the last frame- 1 4906 

-display scaled-down subpixel optimized frame bitmap, or at least 
scaled subpixel optimized bitmaps of changed portion of 
frame- 1 4908 
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-game server computer- 1 5000 

-if have receive user input from one or more game client computers- 1 5002 
-feed it to game engine- 1 5004 

-have game engine compute display list for current frame (or changes to 
display list for current frame)- 1 5006 

-have 3-d rendering routine render bitmap frame of current display list(or 
current changes to display list) at higher resolution than that at which 
corresponding subpixel-optimized bitmaps will be shown- 1 5008 
-scale-down and subpixel optimizie current frame bitmap(or bitmaps of 
current changes to frame and their scaled down locations)- 1 5010 

-compress one or more successive scaled-down subpixel optimized bitmaps 
(and their locations) ~ 1 5012 

-download compressed, scaled, subpixel-optimized animation frames (or 
changes and their locations) to game client- 1 5014 

FIG. 150 



-game client- 1 51 00 

-receive downloaded images (and screen locations)- 1 51 01 

-decompress animated images (and screen locations)- 1 51 02 

-displays the scaled, subpixel optimized animation frame bitmaps (or change 

bitmaps at their respective positions)- 1 51 04 

-if have received any user input- 1 51 06 

-upload user input to game server- 1 51 08 
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subpixel optimization of images with transparency maps- 1 5200 

-produce scaled, either a bicolor or multicolor subpixel-optimized bitmap of 
the foreground image- 1 5202 

-produce a correspondingly scaled, bicolor subpixel optimized bitmap of the 
images transparency map- 1 5204 

-display foreground image's bitmap on a subpixel optimized display 
including:- 1 5206 

-for each pixel row of the displayed image- 1 5208 
-for each subpixel of such row- 1 5210 

-set currentAlpha to the alpha value of the 
corresponding subpixel of the transparency map- 1 521 2 
-set the luminosity of the current subpixel to 
currentAlpha times the luminosity of the corresponding 
subpixel of the foreground image plus (1 - currentAlpha) 
times the prior luminosity value of the current 
subpixel- 1 521 4 

FIG. 152 



-subpixel optimizing video having interpolation between keyframes- 1 5300 
-decompress video- 1 5302 

-scale and subpixel optimizing key frames- 1 53040 

-scale but do not subpixel optimize interpolated changes between keyframes 
because of its rapid speed- 1 5306 

-display scaled video on subpixel addressable display with subpixel 
optimized keyframes and non-subpixel optimized interframe 
interpolation- 1 5308 

FIG. 153 



-subpixel optimizing video representing changes to portions of frame- 1 5400 
-decompress video- 1 5402 
-scale and subpixel optimizing frames- 1 5404 

-scale and subpixel optimize change bitmaps, scale their location relative to 
frame- 1 5406 

-repeatedly display on subpixel addressable display- 1 5407 

-any scaled, subpixel optimized video frame followed by a sequence 
of one or more scaled subpixel optimized change bitmaps over the 
bitmap of that frame at corresponding scaled positions on the 
frame- 1 5408 
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-moving images with fixed subpixelation-15500 

-store subpixel-optimized bitmap of image- 1 5502 

-for each successive frame time- 1 5503 

-calculate movement of image at fixed size and orientation, rounding 
location to nearest horizontal and vertical whole pixel location- 1 5504 
-display image at that location- 1 5506 

FIG. 155 



-moving image with changing subpixelation-15600 
-store high resolution source image- 1 5602 
-for each successive frame time- 1 5603 

-calculate translation, rotation, and/or transformation of high resolution 

source— 1 5604 

-generate scale-down and subpixel optimized bitmap of image with 
images mapping into subpixel grid associated with bitmap being a 
function of its tranlation, rotation, and/or transformation- 1 5606 
-display resulting subpixel optimized bitmap on subpixel 
display—I 5608 

FIG. 156 



-subpixel optimazation of DVD video- 1 5700 

-decompress DVD video to a resolution higher than that at which it is to be 
displayed in subpixel optimized image- 1 5702 

-scale and supixel optimize decompressed bitmaps of video images- 1 5704 
-display scaled subpixel optimized bitmaps of video images on subpixel 
addressable display- 1 5706 

FIG. 157 



-subpixel optimization of HDTV- 1 5800 

-decompress HDTV video to a resolution higher than that at which it is to be 
displayed in subpixel optimized image- 1 5802 

-scale and supixel optimize decompressed bitmaps of video images- 1 5804 
-display scaled subpixel optimized bitmaps of video images on subpixel 
addressable display- 1 5806 
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-subpixel optmization of mpeg4-1 5900 

-receive and decompress mpeg4 video-15902 

-use bicolor subpixel optimization with non-linear color balance in scaling 
down of bicolor objects- 1 5904 

-use multi-color subpixel optimization in scaling down of non-bicolor 
objects- 15906 

-display combination of bicolor and multicolor objects on subpixel optimized 
display moving subpixel optimized objects relative to screen-15908 

FIG. 159 

-server subpixel optimization of scaled down, downloaded video-16000 
-receives request for video and specification of subpixel display 
resolution-16002 

-receives requested video content-16004 

-scales down and subpixel optimizes the received video to subpixel 

resolution association with request- 1 6006 

-compresses video- 1 6008 

-downloads it to requesting device- 1 6010 

FIG. 160 

-proxy subpixel optimization of scaled down, downloaded video- 1 61 00 

-proxy computer code-16100 

-when receive request for video (and specification of subpixel 
resolution)-16102 

-send corresponding request for the requested video to a 
server-16103 
-when receive requested video content-16104 

-scale down and subpixel optimizes video (to specified subpixel 
resolution)-! 61 06 

-compress subpixel optimized video-16108 
-download it to thin client-1 61 1 0 

-thin client code-16112 

-in response to user input, send request for video to proxy (including 
subpixel resolution at which video is to be displayed)-161 13 
-when receive requested video from proxy- 1 61 14 
-decompress video-1 6115 

-display scaled-down decompressed video on subpixel 
addressable display-1 61 1 6 

FIG. 161 
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-Electronic ink code~1 6200 

-if user enters electronic ink input-16202 

-record strokes as series of points and curves or lines in 
between-16204 

-draw ink on screen using subpixel optimization of lines and curves 

with non-linear color balance-16206 
-if user selects to scale up representation of electronic ink-16208 

-produce subpixel optimized bitmap of ink's lines and curves using 

bicolor subpixel optimization with non-linear color balancing at the 

selected scaled up size-16210 

-display scaled up image-16212 
-if user selects to scale down representation of electronic ink-16214 

-to produce subpixel optimized bitmap of ink's lines and curves using 

bicolor subpixel optimization with non-linear color balancing at the 

selected scaled down size-16216 

-display scaled down image-16218 
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-subpixel optimized font bitmaps with non-linear color balance~6000A 

-determine tightest rectangular array of rasterazition units into which 
character font shape fits, taking into account alignment of character-font 
shape relative to raterization units due to hinting18202 
-for each pixel row-6002A 

-for each subpixel in a row~6004 

-determine a coverage value representing the percent of the 
subpixel which is covered by the font shape-6006 
-map resulting array of subpixel coverage values into an array of subpixel 
addressable pixels, aligning first column of rasterization units with leftmost 
subpixel of a pixel row~18204 

-pad array with pixel column comprised of three subpixel's each to 
left-18206 

-pad array with two, three, or four more sub-pixel columns to right, so as to 
cause the total number of sub-pixel columns to be an even multiple of 
three-18208 

-adjust left and right side bearing values to compensate for padding subpixel 
column on left and right side of bitmap-18210 
-perform non-linear color balancing-18212 
-convert to packed color value pixel bitmap-18214 

FIG. 182 



-drawing character string-18300 

-set pen position to start position for string-18302 

-for each character of string to be displayed~9714A 
-access its associated font bitmap~9716 
-set character start position to pen position-18304 
-adjust pen position by left side bearing-18306 
-for each pixel value of the font bitmap-9718 

-if pixel is non-zero, draw pixel! 8308 
-set pen position to character start position plus current character's 
advance width-18310 



FIG. 183 
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-selected text reflow-18500 

-access web page's contents-18502 

-perform first layout of web page's contents, placing text at different 

horizontal locations as indicated by web page-18504 

-display elements of web page at positions determined by the first 

layout-18506 

-enable user to select a portion of text at a given horizontal location in 
display of first layout- 1 8508 

-respond to user selection of such a portion of text by-18510 

-performing a second layout of the selected text by re-flowing it in a 
new column, at a different font size relative to new column's 
width-18512 

-displaying layout of new column at scale that fills at least two thirds of 
width of screen-18514 

FIG. 185 



-zoom to fit-1 8600 

-access web page's contents- 1 8602 
-perform layout of web page's contents-18604 
-display all or portion of layout at first scale-18606 

-enable user to drag pointing device across first scale layout display; -18608 
-if drag continues across screen boundary -18610 

scroll onto screen portions of layout at first scale previously off 

screen-18612 
-if drag is released-18614 

-define selected layout part based on position in first scale layout 

display of start and end of drag -1 861 6 
-display selected part of layout at second scale that fits selected layout part 
to screen. -18618 

FIG. 186 



-drag scroll -18700 

-access web page's contents-18702 
-perform layout of web page's contents- 18704 
-display all or portion of layout-1 8706 

-enable user to drag a pointing device across display of layout-1 8708 
-responding to any such drag across a boundary associated with a screen 
edge by scrolling onto screen, past the screen edge, portions of layout 
previously off screen-1 871 0 



FIG. 187 
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-clickzoom- 1 8800 

-access web page's contents- 1 8802 

-perform layout of web page's contents- 1 8804 

-display all or portion of layout at first scale- 1 8806 

-enable user to click a pointing device at a selected location in display of 

layout at first scale- 1 8808 

-responding to such a click by performing a zoomed display of portion of 
layout around selected location- 1 8810 

FIG. 188 

-zoomclick-18900 

-access web page's contents- 1 8902 

-perform layout of web page's contents- 18904 

-display all or portion of layout at first scale on touch screen- 1 8906 

-if user presses touch screen at first position in first scale layout 

display- 1 8908 

-replace first scale layout display with a display at larger scale of 

portion of layout that includes first position at substantially same 

position on screen as in first scale layout display- 1 8910 

-display cursor slightly above location of touch-18912 

-respond to any movement of touch by correspondingly moving cursor 

on display at second scale- 1 8914 

-respond to any movement of touch across a boundary associated 
with a screen edge by scrolling onto screen, past the screen edge, 
portions of layout at second scale previously off screen- 1 891 6 
-if user subsequently releases of press at a selected position in 
second scale layout display- 1 891 8 n 

-act as if a mouse click had occurred at corresponding position 

relative to web page- 1 8920 

-replace second scale layout display with first scale layout 
display- 1 8922 
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-zoom out with greeking-19000 

-access web page's contents- 1 9002 

-perform layout of web page's contents- 1 9004 

-if user has selected given larger display scale- 1 9006 

-display portion of web page's layout at larger scale, including- 1 9008 
-representing layout's images with bitmap images scaled for 
display at larger scale- 1 901 0 

-representing layout's strings by bitmap images composed of 
font bitmaps sized for display at larger scale- 1 901 2 
-if user has selected given smaller display scale- 1 901 4 

-display portion of web page's layout at smaller scale, 

including- 1 901 6 

-representing layout's images with bitmap images scaled for 
display at smaller scale- 1 901 8 

-representing layout's strings by bitmaps composed of a 
greeked text representation designed to indicate size and 
location of each such string at smaller scale- 1 9020 

FIG. 190 

-if user selects pop-up menu- 1 9*1 00 

-display pop-up menu- 1 9 1 01 

-if user selects size button- 1 91 02 

-show the display size options menu- 1 91 04 
-if user selects 800x600 layout- 1 9106 

-remove pop-up menu from screen- 1 9 1 08 
-send a virtual resolution command that:- 1 9 1 !0 

-sets font set to a smaller font set, including 8, 9, and 10 
pixel per em fonts- 1 91 12 
-sets virtual screen size to 800x600- 1 9 1 1 4 
-sets scale factor to 2.5- 1 9 1 1 6 
-if user selects 640x480 layout- 1 91 1 8 

-remove pop-up menu from screen- 1 9 1 20 
-send a virtual resolution command that:- 1 9 1 22 
-set virtual screen size to 640x480- 1 9 1 24 
-set font set to smaller font set, including 8, 9, and 10 
pixel per em fonts- 1 91 26 
-set scale factor to 2- 1 9128 
-if user selects 480x320- 1 9 1 30 

-remove pop-up menu from screen- 1 91 32 
-send a virtual resolution command that:- 1 91 34 
-set virtual screen size to 480x320- 1 9 1 36 
-set font set to larger font set, including 11, 12, and 13 
pixel per em fonts- 1 91 38 
-set scale factor to 1 .5- 1 91 40 

FIG. 191 

-if receive virtual resolution command from thin client- 1 0554 

-change browser's virtual screen resolution to requested virtual 
resolution- 1 0556 

-change font set to requested font set - 1 9202 
-change scale factor to requested scale factor - 1 9204 
-call for screen redraw- 1 obbU 

FIG. 192 
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Y«u mtM tltjn in to read or und mail. 




N»w to Yahoo!? 

Cm UiUflHUril CNtr Editor*' Chokat 

4>-- ' ■ 



Fr«« rtot»-of-th«-*rt ts«m protection 
Accsis from rirtoaBr «nf wh»r», anytime 
E«f •ccou to Yahoo > lervkat lika Arfdrai* ' 
Book and CiUnrfar ... 

Sign up now 



Yahoo) ID: j™ 



; r";R»mtmber rny to on mis computer 



CalthaaanflaMn* j« 



Yahoo! Mall lor Imtraational U**rc 
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Microsoft active 
on all fronts 
The software maker 
keeps busy with national 
security, corporate IM and 



server OS efforts. 



internet faces 
free-speech test 
The Supreme Court steps 
into a debate that could 
set new rules for access 
to online information. 



Smaller power sources on the horizon 
Researchers and the electronics industry are racing to 
create smaller. Longer-lasting batteries and are tapping 
sources such as hydrogen gas and decaying isotopes. 
November I3 r 2002, B:32 AM PST 

PC Links to move on the double 
fin industry group says it is working on a new PCI 
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Microsoft active 
on all fronts 
The software maker 
keeps ousy with 
national security, 
corporate IM and 
server OS efforts. 




Internet faces 
free-speech test 
The Supreme court 
steps into a debate 
that could set new 
rules for access to 
online information. 





Smaller power sources on the horizon 
Researchers and the electronics industry are 
raring to ere ate smaller, longer-lasting 
batteries and are tapping sources such as 
hydrogen gas and decaying isotopes. 
November 1 3, 2002, 8:32 AM PST 

PC links to move on the double 
An industry group says it is working on a 



■ On the 
offensive at 

OradeWorld 

■ P2P stars make 
business plans 

• ViewSonic 
picks Microsoft 
displays 

- Apple Web dpp 
opens doors 
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Microsoft active 
on all fronts _ 
Th* t oamn makar kaaps busy ISSi 
wen national t*eurrry. torpor*?* 
IM and **iv*r OS tfiort*. 




Internet faces 
free-speech test 



Smaller power sources on the horizon 



PC Connect km 




PC links to move on the double 

An in sultry group say* d it working on a new PCI connection 

standard that win doubl* the spaad or data transtar bstwaen PC 



MusicMarch in tune with label* 



sanrics. powsrad by trash agraamants won four major r# cording 
tabals. Including 8*0 and Untmrsai. 

Toshiba licenses TTVo technology 
A U 8. subsidiary of Toshiba llcansas digital *dao r» cording 
technology and hop* * to haw products using « availabl* by hoUday 
saason 7003 

Start-up to carve out tablet niche 
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Smaller purer sources mn the hsrizin 

Hesearffiers and the elsslrsnies industry an 
radng to ereate smaller,. Hanger-lasting 

Batteries and are tapping sauries sudi 
" gas and delaying isi 

iir 1 3v 2002, 1:32 AM 
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